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Thank you for coming. 


Over the next half hour | am going to be breaking down and explaining the cloud 
system for Horizon Zero Dawn. 


As Natasha mentioned, my background is in Animated film VFX, with experience 
programming for voxel systems including clouds. 


This was co-developed between myself and a programmer named Nathan Vos. He 
could not be here today, but his work is an important part of what we were able to 
achieve with this. 


Horizon was just announced at E3 this year, and this is the first time that we are 
sharing some of our new tech with the community. What you are seeing here renders 
in about 2 milliseconds, takes 20 mb of ram and completely replaces our asset based 
cloud solutions in previous games. 


Before | dive into our approach and justification for those 2 milliseconds, let me give 
you a little background to explain why we ended up developing a procedural 


volumetric system for skies in the first place. 


In the past, Guerrilla has been known for the KILLZONE series of games, which are 
first person shooters . 
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FPS usually restrict the player to a predefined track, which means that we could hand 
place elements like clouds using billboards and highly detailed sky domes to create a 
heavily art directed sky. 


These domes and cards were built in Photoshop by one artist using stock 
photography. As Time of day was static in the KILLZONE series, we could pre-bake our 
lighting to one set of images, which kept ram usage and processing low. 


By animating these dome shaders we could create some pretty detailed and epic sky 
scapes for our games. 


Horizon is a very different kind of game... 
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Horizon trailer 


The World of Horizon >. 


= Open World -the player can traverse large distances 
a Day/Night Cycle 

= Dynamic Weather 

=» Epic Scenery — Mountains, Forests, Lakes 


Skies — Part of the landscape 
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So, from that you could see that we have left the world of Killzone behind. 


Horizon is a vastly open world where you can pretty much go anywhere that you 
see, including the tops of mountains. 

Since this is a living real world, we simulate the spinning of the earth by having a 
time of day cycle. 

Weather is part of the environment so it will be changing and evolving as well. 
There’s lots of epic scenery: Mountains, forests, plains, and lakes. 

Skies are a big part of the landscape of horizon. They make up half of the screen. 
Skies are also are a very important part of storytelling as well as world building. 


CONCEPT ART 


They are used to tell us where we are, when we are, and they can also be used as 


thematic devices in storytelling. 


Cloud Goals 


Art-directable 

Realistic 

Integration with weather 
Movement over time 


Epic! 
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For Horizon, we want the player to really experience the world we are building. So we 


decided to try something bold. We prioritized some goals for our clouds. 


Art direct-able 

Realistic Representing multiple cloud types 
Integrate with weather 

Evolve in some way 

And of course, they needed to be Epic! 


Early Cloud ee ie 
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Realistic CG clouds are not an easy nut to crack. So, before we tried to solve the 
whole problem of creating a sky full them, we thought it would be good to explore 
different ways to make and light individual cloud assets. 


Early Cloud Explorations 


a Simulated Shapes 


£ 
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e Our earliest successful modeling approach was to use a custom fluid solver to 
grow clouds. The results were nice, but this was hard for artists to control if they 
had not had any fluid simulation experience. Guerrilla is a game studio after all. 


Early Cloud Explorations 


a Simulated Shapes 
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We ended up modeling clouds from simple shapes, 
e voxelizing them and then... 

e Running them through our fluid solver ... 

e Until we got a cloud like shape . 


Early Cloud Explorations 


a Simulated Shapes 


a Custom Lighting Model 
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And then we developed a lighting model that we used to pre-compute primary and 

secondary scattering, 

e Ill get into our final lighting model a little later, but the result you see here is 
computed on the cpu in Houdini in 10 seconds. 


Early Cloud Explorations 


Simulated Shapes 
Custom Lighting Model 
In-Game Representations 


a Poly Clouds 
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We explored 3 ways to get these cloud assets into game. 

e For the first, we tried to treat our cloud as part of the landscape, literally modeling 
them as polygons from our fluid simulations and baking the lighting data using 
spherical harmonics. This only worked for the thick clouds and not whispy ones ... 


Early Cloud Explorations 


a Simulated Shapes 

a Custom Lighting Model 

= In-Game Representations 
. Poly Clouds 


a Billboards 
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So, we though we should try to enhance the billboard approach to support multiple 
orientations and times of day . We succeeded but we found that we couldn’t easily 
re-produce inter cloud shadowing. So... 


Early Cloud Explorations 


Simulated Shapes 

Custom Lighting Model 

In-Game Representations 
Poly Clouds 
Billboards 


Sky Domes 


Evolution 
Overhead clouds 


Performance 
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e We tried rendering all of our voxel clouds as one cloud set to produce skydomes 
that could also blend into the atmosphere over depth. Sort of worked. 
At this point we took a step back to evaluate what didn’t work. None of the 
solutions made the clouds evolve over time. There was not a good way to make 
clouds pass overhead. And there was high memory usage and overdraw for all 
methods. 

e So maybe a traditional asset based approach was not the way to go. 


Voxel Clouds ?!? 


Traditionally expensive 

a Lots of texture reads 

a Ray marches 

a Nested loops 

Lots of proven methods for real-time volumetric lighting 
Convincing work using noise to model clouds (PVR) 


Can we solve the expense and leverage on the possible look advantages? 
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Well, What about voxel clouds? 
OK we are crazy we are actually considering voxel clouds now... 
As you can imagine this idea was not very popular with the programmers. 


Volumetrics are traditionally very expensive 

With lots of texture reads 

Ray marches 

Nested loops 

However, there are many proven methods for fast, believable volumetric lighting 
There is convincing work to use noise to model clouds . | can refer you to the 2012 
Production Volume Rendering course. 

Could we solve the expense somehow and benefit from all of the look advantages 
of volumetrics? 


Voxel Clouds ?!? 
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Our first test was to stack up a bunch of polygons in front of the camera and sample 
3d Perlin noise with them. While extremely slow, This was promising, but we want to 
represent multiple clouds types not just these bandy clouds. 


Voxel Clouds ?!? 
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So we went into Houdini and generated some tiling 3d textures out of the simulated 
cloud shapes. Using Houdini’s GL extensions, we built a prototype GL shader to 
develop a cloud system and lighting model. 


Voxel Clouds ?!? 


Photograph GL Shader, Houdini Viewport 
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In The end, with a LOT of hacks, we got very close to mimicking our reference. 


However, it all fell apart when we put the clouds in motion. It also took 1 second per 
frame to compute. For me coming from animated vfx, this was pretty impressive, but 
my colleagues were still not impressed. 

So | thought, Instead of explicitly defining clouds with pre determined shapes, what if 
we could develop some good noises at lower resolutions that have the characteristics 
we like and then find a way to blend between them based on a set of rules. There has 
been previous work like this but none of it came close to our look goals. 


Modeling 
Lighting 
Rendering 


Optimization 
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This brings us to the clouds system for horizon. To explain it better | have broken it 


down into 4 sections: Modeling, Lighting, Rendering and Optimization. 


Before | get into how we modeled the cloud scapes, it would be good to have a basic 
understanding of what clouds are and how they evolve into different shapes. 


Modeling 


= The Cloud Types 
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cirrostratus cirrocumulus 
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altostratus altocumulus 4000m 
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stratus stratocumulus cumulus cumulonimbus 
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Classifying clouds helped us better communicate what we were talking about and 


Define where we would draw them. The basic cloud types are as follows. 

The strato clouds including stratus, cumulus and stratocumulus 

The alto clouds, which are those bandy or puffy clouds above the strato layer 

And the cirro clouds those big arcing bands and little puffs in the upper 
atmosphere. 

Finally there is the granddaddy of all cloud types, the Cumulonimbus clouds which 
go high into the atmosphere. 

For comparison, mount Everest is above 8,000 meters. 


Modeling 


Density increases at lower temperatures 
Temperature decreases over altitude 


High densities precipitate as rain or snow 


Wind direction varies over altitude 


“With. more than 85 illustrations 


They rise with heat from the earth 
Dense regions make round shapes as they rise 
Light regions diffuse like fog 


Atmospheric turbulence further distorts clouds. 
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After doing research on cloud types, we had a look into the forces that shape them. 
The best source we had was a book from 1961 by two meteorologists, called “The 
Clouds” as creatively as research books from the 60’s were titled. What it lacked in 
charm it made up for with useful empirical results and concepts that help with 
modeling a cloud system. 


Density increases at lower temperatures 
Temperature decreases over altitude 
High densities precipitate as rain or snow 
Wind direction varies over altitude 

They rise with heat from the earth 


Dense regions make round shapes as they rise 


Light regions diffuse like fog 


Atmospheric turbulence further distorts clouds. 


These are all abstractions that are useful when modeling clouds. 


Modeling 
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Our modeling approach uses ray marching to produce clouds. 
e We march from the camera and sample noises and a set of gradients to define our 
cloud shapes using a sampler 


Modeling 


IN-GAME RENDER 


In a ray march you use a sampler to... 
e Build up an alpha channel... 
e And calculate lighting 


Modeling 


fBm — fractal Brownian motion 


* Layered Perlin Frequencies 
Height Gadient | 


UP 
À 


The Ground 
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There are many examples of real-time volume clouds on the internet. The usual 
approach involves drawing them in a height zone above the camera using something 
called fBm, Fractal Brownian Motion. This is done by layering Perlin noises of 
different frequencies until you get something detailed. 


(pause) 
e This noise is then usually combined somehow with a gradient to define a change in 
cloud density over height. 


x y 
Modeling e 7 


This makes some very nice but very procedural looking clouds. What’s wrong? There 
are no larger governing shapes or visual cues as to what is actually going on here. We 
don’t feel the implied evolution of the clouds from their shapes. 


Modeling 
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By contrast, in this photograph we can tell what is going on here. These clouds are 
rising like puffs of steam from a factory. Notice the round shapes at the tops and 
whispy shapes at the bottoms. 


Modeling ae 


SHADERTOY VIEWPORT 


This fBm approach has some nice whispy shapes, but it lacks those bulges and billows 
that give a sense of motion. We need to take our shader beyond what you would find 
on something like ShaderToy. 


Modeling 
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e These billows, as III call them... 
e are packed, sometimes taking on a cauliflower shape. 
Since Perlin noise alone doesn’t cut it, we developed our own layered noises. 


Modeling 


Worley Noise — Steven Worley, 1996 
a Packed billowed shapes 
Layered like fBm 
Used to dilate Perlin Noise 


Perlin-Worley` noise 
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Worley noise was introduced in 1996 by Steven Worley and is often used for caustics 
and water effects. If it is inverted as you see here: 

e It makes tightly packed billow shapes. 

e We layered it like the standard Perlin fBm approach 


Then we used it as an offset to dilate Perlin noise. this allowed us to keep the 
connectedness of Perlin noise but add some billowy shapes to it. 
We referred to this as `Perlin-Worley` noise 


Modeling 


Using noise in real-time shaders 
Noises stored as textures 
As few texture reads as possible 
Lower resolutions when possible 
Our noises 


2 3D Textures 


a 12D Texture 


In games, it is often best for performance to store noises as tiling 3d textures. 
You want to keep texture reads to a minimum... 

and keep the resolutions as small as possible. 

In our case we have compressed our noises to... 

two 3d textures... 

And 1 2d texture. 


Modeling 


3dTexture 1 

* 4Channels 

= 128% resolution 
a 1 Perlin-Worley 


. 3 layered Worley 
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The first 3d Texture... 

has 4 channels... 

it is 1283 resolution... 

The first channel is the Perlin - Worley noise | just described. 

The other 3 are Worley noise at increasing frequencies. Like in the standard 
approach, This 3d texture is used to define the base shape for our clouds. 


Modeling 


3dTexture 2 
* 3 Channels 
= 323 resolution 


= 3 Worley 


ADVANCES IN REAL - 
TIME RENDERING 2015 


Our second 3d texture... 

has 3 channels... 

it is 32^3 resolution... 

and uses Worley noise at increasing frequencies. This texture is used to add detail 
to the base cloud shape defined by the first 3d noise. 


Modeling 


2D Texture 
* 3 Channels 
= 128^? resolution 


=a 3 curl noise dims 
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Our 2D texture... 

has 3 channels... 

it is 128^2 resolution... 

and uses curl noise. Which is non divergent and is used to fake fluid motion. We 
use this noise to distort our cloud shapes and add a sense of turbulence. 


Modeling 


Height Gradients í ) 
* 3x Mathematical 
* Blends based on 

cloud type —_—_—_—_—_—_—_—_—__ 


Stratus Cumulus Cumulonumbis 
Coverage Signal 


Oto 1 range 
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Recall that the standard solution calls for a height gradient to change the noise 
signal over altitude. Instead of 1, we use... 

3 mathematical presets that represent the major low altitude... 

cloud types when we blend between them at the sample position. 

We also have a value telling us how much cloud coverage we want to have at the 
sample position. This is a value between zero and 1. 


Modeling 


1. Sample 3dTexture1 & Multiply this by the height signal to build 


low resolution cloud 


2. Erode and multiply the result by a coverage signal (0 to 1) and 


reduce density at the base of the cloud 


ae 
SetRange ( SR X = ) X coverage X 


p 
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What we are looking at on the right side of the screen is a view rotated about 30 
degrees above the horizon. We will be drawing clouds per the standard approach in a 
zone above the camera. 


First, we build a basic cloud shape by sampling our first 3dTexture and multiplying 
it by our height signal. 

The next step is to multiply the result by the coverage and reduce density at the 
bottoms of the clouds. 


and multiply the result by a cove 


sity at the base of the clo 
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This ensures that the bottoms will be whispy and it increases the presence of clouds 


in a more natural way. Remember that density increases over altitude. Now that we 
have our base cloud shape, we add details. 


Modeling 


Sample 3DTexture1 & Multiply this by the height signal to build 
low resolution cloud 
Erode and multiply the result by a coverage signal (0 to 1) and 


reduce density at the base of the cloud 
Sample 3DTexture2 & erode the base cloud at its edges 


Distort 3DTexture2 by 2D curl noise 


base cloud shape (edges) at x curl noise ) 
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The next step is to... 

e erode the base cloud shape by subtracting the second 3d texture at the edges of 
the cloud. Little tip, If you invert the Worley noise at the base of the clouds you get 
some nice whispy shapes. 

We also distort this second noise texture by our 2d curl noise to fake the swirly 
distortions from atmospheric turbulence as you can see here... 


Modeling 
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Here’s that it looks like in game. I’m adjusting the coverage signal to make them 
thicker and then transitioning between the height gradients for cumulus to stratus. 


Now that we have decent stationary clouds we need to start working on making them 
evolve as part of our weather system. 


Modeling 


m 


Weather System 


s Cloud Coverage 


= Cloud Type 


= Precipitatior 
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These two controls, cloud coverage and cloud type are a FUNCTION of our weather 


system. 
e There is an additional control for Precipitation that we use to draw rain clouds. 


Modeling § 


Coverage: + 
Type = +- 1 


Precipitation = +-1 
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Here in this image you can see a little map down in the lower left corner. This 
represents the weather settings that drive the clouds over our section of world map. 
The pinkish white pattern you see is the output from our weather system. Red is 
coverage, Green is precipitation and blue is cloud type. The weather system 
modulates these channels with a simulation that progresses during gameplay. The 
image here has Cumulus rain clouds directly overhead (white) and regular cumulus 
clouds in the distance. We have controls to bias the simulation to keep things art 
direct-able in a general sense. 
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Coverage: +- .5 - 
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The default condition is a combination of cumulus and stratus clouds. The areas that 
are more red have less of the blue signal, making them stratus clouds. You can see 
them in the distance at the center bottom of the image. 


Coverage: + 
Type = +- 1 


Precipitation = +-1 
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The precipitation signal transitions the map from whatever it is to cumulonimbus 


clouds at 70% coverage. 


Modeling 
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The precipitation control not only adjusts clouds but it creates rain effects. In this 
video | am increasing the chance of precipitation gradually to 100% 


Modeling 
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If we increase the wind speed and make sure that there is a chance of rain, we can 
get Storm clouds rolling in and starting to drop rain on us. This video is sped up, for 
effect, btw. Ahhh... Nature Sounds. 


Modeling 


20,000m 


35,000m 


ADVANCES IN REAL - 
TIME RENDERING 2015 


We also use our weather system to make sure that clouds are the horizon are 
always interesting and poke above mountains. 

We draw the cloudscapes within a 35,000 meter radius around the player.... 
and Starting at a distance of 15,000 meters... 

we start transitioning to cumulus clouds at around 50% coverage. 


Modeling 


This ensures that there is always some variety and ‘epicness’ to the clouds on the 
horizon. 


So, as you can see, the weather system produces some nice variation in cloud type 
and coverage. 


Modeling 
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In the case of the e3 trailer, We overrode the signals from the weather system with 
custom textures. You can see the corresponding textures for each shot in the lower 
left corner. We painted custom skies for each shot in this manner. 


Modeling 


Ray March / Sampler 
2 Levels of detail 
a LF Base cloud shape 
= HF Detail and distortion 
Custom noises made from Perlin, Worley 
and Curl noise 


Density modulated by height signals and 


Driven by weather simulation / User input 


Animated 
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So to sum up our modeling approach... 

we follow the standard ray-march/ sampler framework 

but we build the clouds with two levels of detail 

a low frequency cloud base shape 

and high frequency detail and distortion 

Our noises are custom and made from Perlin, Worley and Curl noise 

We use a Set of presets for each cloud type to control density over height and cloud 
coverage 

These are driven by our weather simulation or by custom textures for use with 
cutscenes 

and it is all animated in a given wind direction. 


Volumetric Cloudscapes 


Modeling 
Lighting 
Rendering 


Optimization 
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Cloud lighting is a very well researched area in computer graphics. The best results 
tend to come from high numbers of samples. In games, when you ask what the 
budget will be for lighting clouds, you might very well be told “Zero”. We decided that 
we would need to examine the current approximation techniques to reproduce the 3 
most important lighting effects for us. 


Lighting Goals 


= Directional Scattering 
a Silver Lining 


= Dark Edges 
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e The directional scattering or luminous quality of clouds... 

e The sliver lining when you look toward the sun through a cloud... 

e And the dark edges visible on clouds when you look away from the sun. 

The first two have standard solutions but the third is something we had to solve 
ourselves. 


Lighting 


Out-scattering 
Absorption 


In-scattering 
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When light enters a cloud 
e The majority of the 
e light rays spend their 
e time refracting 
e off of water 
droplets and 
ice inside of 
the cloud 
e before heading 
e to our eyes. 
(pause) 
e By the time the light ray finally exits the cloud it could have been out scattered... 
e absorbed by the cloud... 
e or combined with... 
e other light rays in what is called in-scattering.. 
In film vfx we can afford to spend time gathering light and accurately reproducing 
this, but in games we have to use approximations. These three behaviors can be 
thought of as probabilities and there is a 
Standard way to approximate the result you would get. 


Lighting 


a Beer's Law 


Depth 
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Beer’s law states that we can determine the amount of light reaching a point based 

on the optical thickness of the medium that it travels through. With Beers law, we 

have a basic way to describe the amount of light at a given point in the cloud. 

e If we substitute energy for transmittance ad depth in the cloud for thickness, and 
draw this out you can see that energy exponentially decreases over depth. This 
forms the foundation of our lighting model. 


but there is a another component contributing to the light energy at a point. It is the 


probability of light scattering forward or backward in the cloud. This is responsible for 
the silver lining in clouds, one of our look goals. 


Lighting 


a Anisotropic Scattering 


= Henyey-Greenstein Model 
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e In clouds, there is a higher probability of light scattering forward. This is called 


Anisotropic scattering. 
e In 1941, the Henyey-Greenstein model was developed to help astronomers with 
light calculations at galactic scales, but today it is used to reliably reproduce 


Anisotropy in cloud lighting. 


Lighting 


a Beer's Law 


a Henyey-Greenstein Function 


Energy = e ¢ * HG 
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Each time we sample light energy, we multiply it by The Henyey-Greenstein phase 
function. 


Lighting 


Beer's Law Only Beer's Law + Henyey-Greenstein Function 
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Here you can see the result. On the left is Just the beers law portion of our lighting 
model. On the right we have applied the Henyey-Greenstein phase function. Notice 
that the clouds are brighter around the sun on the right. 


Lighting 
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But we are still missing something important, something that is often forgotten. The 
dark edges on clouds. This is something that is not as well documented with solutions 
so we had to do a thought experiment to understand what was going on. 


Lighting 
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Think back to the random walk of a light ray through a cloud. 


If we compare a point inside of the cloud to one near the surface, the one inside 
would receive more in scattered light. In other words, Cloud material, if you want 
to call it that, is a collector for light. The deeper you are in the surface of a cloud, 
the more potential there is for gathered light from nearby regions until the light 
begins to attenuate, that is. 


This is extremely pronounced in round formations on clouds, so much so that the 


crevices appear... 
to be lighter that the bulges and edges because they receive a small boost of in- 


scattered light. 


Normally in film, we would take many many samples to gather the contributing light 
at a point and use a more expensive phase function. You can get this result with brute 
force. If you were in Magnus Wrenninge’s multiple scattering talk yesterday there was 
a very good example of how to get this. But in games we have to find a way to 
approximate this. 


Lighting 
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A former colleague of mine, Matt Wilson, from Blue Sky, said that there is a similar 
effect in piles of powdered sugar. So, Ill refer to this as the powdered sugar look. 


Lighting 
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Once you understand this effect, you begin to see it everywhere. It can not be un- 
seen. 
Even in light whispy clouds. The dark gradient is just wider. 


Lighting 


Beer’s Law 
Surface 
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The reason we do not see this effect automatically is because our transmittance 

function is an approximation and doesn’t take it into account. 

e The surface of the cloud is always going to have the same light energy that it 
receives. Lets think of this effect as a statistical probability based on depth. 


Lighting 


Beer’s-Powder 


Beer’s Law 
Surface 
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As we go deeper in the cloud, our potential for in scattering increases and more of it 
will reach our eye. 


e If you combine the two functions you get something that describes this... 
e effect as well as the traditional approach. 


| am still looking for the Beer’s-Powder approximation method in the ACM digital 
library and I haven’t found anything mentioned with that name yet. 


Lighting 


No Lighting 


Beer’s Law 


Powder Effect 


‘Beer’s-Powder’ Effect 
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Lets visually compare the components of our directional lighting model 
e The beer’s law component which handles the primary scattering... 
e the powder sugar effect which produces the dark edges facing the light... 
e And their combination in our final result. 


Lighting 


Beer’s Law 


‘Beer’s-Powder’ Effect 
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Here you can see what the beer’s law and combined beer’s law and powder effect 
look like when viewed from the light source. This is a pretty good approximation of 
our reference. 


Lighting 


In game, it adds a lot of realism to the 
e thicker clouds and helps sell the scale of the scene. 


Lighting 
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But we have to remember that this is a view dependent effect. We only see it where 
our view vector approaches the light vector, so the powder function should account 
for this gradient as well. 


Lighting 
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Here is a panning camera view that shows this effect increasing as we look away from 
the sun. 


Lighting 


The last part of our lighting model is that we artificially darken the rain clouds by ... 
e increasing the light absorption where they exist. 


Lighting 


Beer's Law 


Henyey-Greenstein Function 


Powder Effect 


Absorption Increases for Energy = e d'r * HG i Z 


Rain clouds. 
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So, in review our model has 3 components: 


Beer’s Law 

Henyen-Greenstein 

our powder sugar effect 

And Absorption increasing for rain clouds 


Modeling 
Lighting 


Rendering 


Optimization 
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| have outlined How our sampler is used to model clouds and how our lighting 
algorithm simulates the lighting effects associated with them. Now | am going to 
describe how and where we take samples to build an image. And how we integrate 
our clouds into atmosphere and our time of day cycle. 


Rendering 


The Earth 
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The first part of rendering with a ray march is deciding where to start. In our 
situation, Horizon takes place on Earth and as most of you are aware... the earth 
round. 


e The gases that make up our atmosphere wrap around the earth and clouds exists 
in different layers of the atmosphere. 


nidata PHOTOGRAPH 


When you are on a “flat” surface such as the ocean, you can clearly see how the 


curvature of the earth causes clouds to descend into the horizon. 
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For the purposes of our game we divide the clouds into two types in this spherical 


atmosphere. 


The low altitude volumetric strato class clouds between 1500 and 4000 meters... 
and the high altitude 2D alto and cirro class clouds above 4000 meters. The upper 
level clouds are not very thick so this is a good area to reduce expense of the 


shader by making them scrolling textures instead of multiple samples in the ray 
march. 
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By ray marching through spherical atmosphere we can... 
e ensure that clouds properly descend into the horizon. 


e It also means we can force the scale of the scene by shrinking the radius of the 
atmosphere. 
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In our situation we do not want to do any work or any expensive work where we 
don’t need to. So instead of sampling every point along the ray, we use our samplers 
two levels of detail as a way to do cheaper work until we actually hit a cloud. 


Rendering 


e Recall that the sampler has a low detail noise that make s basic cloud shape 

e anda high detail noise that adds the realistic detail we need. 

The high detail noise is always applied as an erosion from the edge of the base cloud 
shape. 
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This means that we only need to do the high detail noise and all of its associated 
instructions where the low detail sample returns a non zero result. 


e This has the effect of producing an isosurface that surrounds the area that our 
cloud will be that could be. 
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So, when we take samples through the atmosphere, we do these cheaper samples at 


a larger step size until we hit a cloud iso surface. Then we switch to full samples with 
the high detail noise and all of its associated instructions. To make sure that we do 


not miss any high res samples, we always take a step backward before switching to 
high detail samples. 
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e Once the alpha of the image reaches 1 we don’t need to keep sampling so we stop 
the march early. 
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If we don’t reach an alpha of one we have another optimization. 
e After several consecutive samples that return zero density, we switch back to the 
cheap march behavior until we hit something again or reach the top of the cloud 
layer. 
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Because of the fact that the ray length increases as we look toward the horizon, we 

start with ... 

e an initial potential 64 samples and end with a... 

e potential 128 at the horizon. | say potential because of the optimizations which 
can cause the march to exit early. And we really hope they do. 

This is how we take the samples to build up the alpha channel of our image. To 

calculate light intensity we need to take more samples. 
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Normally what you do in a ray march like this is to ... 
e take samples toward the light source, plug the sum into your lighting equation and 


then attenuate this value using the alpha channel until you hopefully exit the 
march early because your alpha has reached 1. 
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In our approach, we sample 6 times in a cone toward the sun. This smooth's the 
banding we would normally get with 6 simples and weights our lighting function with 
neighboring density values, which creates a nice ambient effect. The last sample is 
placed far away from the rest ... 

e inorder to capture shadows cast by distant clouds. 
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Here you can see what our clouds look like with just alpha samples... 

e With our 5 cone samples for lighting. 

e And the long distance cone sample. 

To improve performance of these light samples, we switched to sampling the cheap 
version of our shader once the alpha of the image reached 0.3. , this made the shader 
2x faster 
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The lighting samples replace the lower case d, or depth in the beers law portion of 
our lighting model. This energy value is then attenuated by the depth of the sample in 
the cloud to produce the image as per the standard volumetric ray-marching 
approach. 
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The last step of our ray march was to... 
e sample the 2d cloud textures for the high altitude clouds 
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These were a collection of the various types of cirrus and alto clouds that were tiling 
and scrolling at different speeds and directions above the volumetric clouds. 
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In reality light rays of different frequencies are mixing in a cloud producing very 
beautiful color effects. Since we live in a world of approximations, we had to base 
cloud colors on some logical assumptions. 


We color our clouds based on the following model: 

e Ambient sky contribution increases over height 

e Direct lighting would be dominated by the sun color 
e Atmosphere would occlude clouds over depth. 


We add up our ambient and direct components and attenuate to the atmosphere 
color based on the depth channel. 
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Now, you can change the time of day in the game and the lighting and colors update 
automatically. This means no pre-baking and our unique memory usage for the entire 
sky is limited to the cost of 2 3d textures and 1 2d texture instead of dozens of 
billboards or sky domes. 
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To sum up what makes our rendering approach unique: 

e Sampler does “cheap” work unless it is potentially in a cloud 

e 64-128 potential march samples, 6 light samples per march in a cone, 
when we are potentially in a cloud. 

e Light samples switch from full to cheap at a certain depth 
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The approach that | have described so far costs around 20 milliseconds. 

(pause for laughter) 

Which means it is pretty but, it is not fast enough to be included in our game. My co- 
developer and mentor on this, Nathan Vos, Had the idea that... 
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e Every frame we could use a quarter res buffer... 
e to update 1 out of 16 pixels for each 4x4 pixel bl.ock within our final image. 
We reproject the previous frame to ensure we have something persistent. 
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..and where we could not reproject, like the edge of the screen, We substitute the 


result from one of the low res buffers. 


Nathan’s idea made the shader 10x faster or more when we render this at half res 
and use filters to upscale it. 

It is pretty much the whole reason we are able to put this in our game. Because of 
this our target performance is around 2 milliseconds, most of that coming from the 
number of instructions. 
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In review we feel that 

We have largely achieved our initial goals. This is still a work in progress as there is 
still time left in the production cycle so we hope to improve performance and direct- 
ability a bit more. We’re also still working on our atmospheric model and weather 
system and we will be sharing more about this work in the future on our website and 
at future conferences. 


e All of this was captured on a playstation 4 
e And this solution was written in PSSL and C++ 
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Are there any questions? 


Peace out. 


